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MAM  AL  REVERSION  FLIGHT  CONTROL  SYSTEM 
FOR  A- 10  AIRCRAFT: 

PILOT  PERFORMANCE  AND  SIMULATOR  Cl  E  EFFECTS 


I.  IMTROOKTION 

The  definition  of  simulator  eue  requirements  is  a  topic  of  continuing  interest  to  designers  of  aircrew  training 
devices  (ATDs).  The  lack  of  a  comprehensive  data  base  often  requires  that  a  specific  study  be  performed  to 
provide  design  data  for  a  particular  ATD  development  program.  As  an  example,  the  present  study  was  conducted  to 
produce  information  that  could  be  used  to  develop  cue  requirements  criteria  for  operational  ATI)  specifications. 


Background 

The  purpose  of  an  ATI)  is  to  provide  training  that  transfers  positively  to  the  aircraft.  Although  this  training  is 
alwavs  intended  to  be  efficient  and  effective,  the  ATI)  may  not  provide  adequate  training  for  some  tasks. 
Normallv.  this  situation  is  satisfied  through  instruction  and  practice  in  the  aircraft,  but  in  the  rase  of  training  for 
certain  malfunctions  and  emergency  procedures,  the  risks  of  training  in  the  actual  aircraft  are  too  great  (or  too 
cosllv).  In  these  instances,  the  only  viable  training  option  is  some  form  of  simulation. 

An  excellent  illustration  of  the  case  in  point  is  found  hv  consideration  of  the  A-10  aircraft  and  its  associated 
subsystems.  The  A-10  was  specifically  designed  for  the  low-level  surface  attack  mission.  Because  of  its  potential 
exposure  to  damage  from  ground  countermeasures  (i.e..  antiaircraft  artillery  and  surface-to-air  missiles),  the  A-IO 
has  a  manual  backup  to  the  "power  assisted"  primary  flight  control  system.  This  backup  control  mode,  the  Manual 
Reversion  Flight  Control  System  (MRFCS).  was  designed  as  an  emergency  system  that  would  enable  the  pilot  to  fly 
a  battle-damaged  plane  to  a  safe  landing  or  ejection  behind  friendly  lines. 

The  inclusion  of  the  MRFCS  gives  the  A- 10  an  added  margin  for  survival,  but  aircraft  control  in  the  manual 
flight  mode  is  exceptionally  demanding  of  piloting  skills.  In  fad.  as  early  as  1073.  it  was  reported  that  there  existed 
an  "unacceptable  pilot  workload  for  the  landing  task  in  the  manual  reversion  mode"  (Papa.  Douglas.  Fortner.  & 
Markwardt.  1073.  p.  7).  As  the  flight  testing  of  the  A-IO  continued,  it  was  found  that  "the  most  significant 
deficiencies  noted  were  unacceptable  load  factor/pitch  attitude  excursions  encountered  during  transition  from  the 
normal  flight  control  systems  to  the  manual  system  at  high  speed.  .  ."  (Papa  &  Bridges.  1074.  p.  6).  The  final  point 
on  A-10  handling  qualities  is  summarized  by  l  nitl.  (1076.  p.  31).  who  stated  that  "pilot  initiated  transition  to 
manual  flight  control  mode  and  subsequent  flight  and  landings  could  be  accomplished,  but  not  without  an 
excessive  pilot  workload." 

Because  manual  aircraft  control  is  so  difficult,  a  critical  requirement  exists  to  train  A- 10  pilots  in  the 
management  of  their  aircraft  under  MRFC.S  operation.  Such  training,  however,  is  extremely  hazardous  and  is  not 
currently  a  part  of  the  initial  flight-training  program.  Explanation  of  the  MRFCS  is  included  in  the  academir 
svllabtis.  but  aircraft  control  in  this  mode  is  not  practiced  in  the  air  until  the  pilot  reaches  the  operational  'raining 
unit  (and  then  only  to  a  very  limited  extent). 

Since  it  was  thought  too  dangerous  to  instruct  MRFC.S  tasks  in  the  actual  aircraft,  it  seemed  logical  to  transfer 
this  training  requirement  to  an  ATD.  For  this  approach  to  succeed,  the  simulation  must  provide  the  cues  required 
to  teach  the  task.  But  at  the  lime  this  study  was  initiated,  a  definition  of  adequate  simulator  MRF’C„S  cue  eondilions 
was  not  available.  Therefore,  the  soundest  method  for  determining  cue  requirements  to  satisfy  this  unique  training 
objective  was  deemed  to  be  an  empirical  lest  of  candidate  ATI)  configurations.  The  Aeronautical  Systems  Division 
( ASD)  of  the  Air  Force  .Systems  Command  addressed  such  a  request  to  the  Operations  Training  Division  of  the  Air 
Force  Human  Resources  Laboratory  (AFHRL/OT).  Although  tile  primary  concern  was  with  the  impact  of  visual 
(i.e..  field  of  view)  and  force  cueing  (i.e..  platform  motion)  variables  on  pilot  performance,  the  progress  and  results 
of  training  were  also  of  considerable  interest. 

While  research  had  not  been  performed  on  field  of  view  (FOV)  and  platform  motion  (PM)  simulator  eue 
requirement*  for  A-10  MRFCS  application*,  some  relevant  data  did  exist.  For  example,  a  recent  review  by  Martin 


(|*)80)  summarized  I  lie  findings  of  a  number  of  studios  on  PM  effects  in  training.  In  general.  for  centerline-thrust 
fighter  and  trainer-type  aircraft.  PM  was  found  to  have  no  significant  positive  impact  on  training.  In  one  study 
(Ryan.  Scott  X  Browning.  I‘)78)  where  PM  was  found  to  he  beneficial,  the  effect  was  limited  to  performance  in  the 
simulator  phase  of  training,  and  the  enhanced  performance  did  not  effect  transfer  to  the  aircraft.  Vi  hen 
considering  the  visual  cue  component,  for  the  tasks  trained  in  the  studies  rex  iewed  by  V  aag.  the  conclusions  seem 
to  follow  a  general  rule:  "visual  tasks  learned  in  the  simulator  show  positive  transfer  to  the  aircraft  (W  aag.  1*181. 
p.  17).  Because  of  the  role  visual  factors  play  in  fly  ing  tasks,  this  is  not  a  surprising  conclusion.  But  the  effects  id 
FOV  (i.e..  wide  versus  narrow  angle)  on  MRFVS-reialed  tasks  were  unknown.  Haag's  report  indicated  that  fO\ 
effects  might  he  very  modest:  consequently,  more  relevant  data  were  needed. 


Objective  and  Study  Rationale 

The  objective  of  this  research  was  to  determine  the  effect  of  selected  simulated  visual  and  force  cues 
(specifically  variations  in  FOV  and  PM)  on  the  ability  of  combat -ready  A- 10  pilots  to  maintain  aircraft  control  and 
land  when  in  tile  MRFVS  mode.  The  research  emphasized  FOV  and  PM  cue  requirements  for  simulated  flight  in 
the  MRFV.S  mode:  however,  further  consideration  of  the  issues  associated  with  the  MRFfiS  necessitated  an 
expansion  of  the  number  of  independent  variables  to  be  included  in  the  study.  Specifically,  three  additional  areas 
of  interest  were  identified:  (a)  the  similarity  between  pilot  control  performance  in  the  MRFliS  and  simple  singlc- 
cngine-oul  flight  conditions,  (h)  the  effects  of  system  failure  on  control  performance  as  a  function  of  occurence 
when  the  aircraft  is  in  different  flight  envelopes,  and  (c)  the  ability  of  pilots  to  be  trained  to  master  the  MRFI.S. 

Fortunately,  all  of  the  desired  data  could  be  obtained  from  one  economically  designed  study.  This  was 
possible  because  the  flight  envelope  of  the  A- 10  aircraft  when  operating  in  a  MRFfiS  mode  is  highly  restricted. 
Thus,  it  followed  that  the  maneuvers,  or  piloting  tasks,  which  needed  to  be  investigated  were  limited  to  basic 
aircraft  control.  It  was  also  assumed  that  the  most  demanding  pilot  workloads  occur  immediately  during  and  after 
transition  from  normal  control  conditions  to  the  MRFVS  mode  and  in  landing.  Consequently .  it  was  possible  to 
develop  a  short  mission  profile  that  could  he  flown  in  (>  to  8  minutes  and  that  would  assess  pilot  performance  in 
these  critical  periods  of  flight. 

The  research  needed  to  he  performed  as  quickly  as  possible.  Fair  this  reason,  the  simulator  selected  on  which 
to  do  the  work  was  the  \d valued  Simulator  for  Pilot  Training  (ASPT)  available  at  Williams  Air  Force  Base. 
Mthough  some  engineering  effort  was  required  on  hardware  and  software  components.  ASPT  capabilities  were 
successfully  expanded  to  include  (lie  MRFV.S  flight  dynamics.  Once  this  was  accomplished,  the  effect  of  certain 
simulator  cues  and  aircraft  stales  on  experienced  pilot  performance  could  be  studied  in  a  straightforward  manner. 


II.  MKTIIODS  AM)  I’ROt  KDt  HUS 

The  primary  variables  of  interest  in  this  study  were  simulator  visual  and  force  cue  requirements.  Two  FOYs 
and  two  PM  force-cueing  methods  were  employed.  The  two  FOV  conditions  used  were  the  full  ASPT  capability 
(1 50  degrees  by  300  degrees)  and  a  restricted  capability  simulation  consisting  of  a  single  window  visual  system 
similar  to  the  VITAL  111  (45  degrees  by  35  degrees).  The  two  PM  cueing  conditions  were  the  total  ASPT  six- 
degrees-of-freedom  PM  system  and  a  zero-degree  of  platform  motion  (fixed  base)  system.  Because  nearly  all 
current  single-seal  simulators  incorporate  g-seat  and  g-suit  capabilities,  these  force-cueing  techniques  were  present 
in  all  ASPT  configurations.  Thus,  the  g-seat/g-suit  force  cueing  constituted  a  fixed  condition  in  the  study. 

The  aircraft  control  am  I  lauding  proficiency  of  combat-ready  A- 10  pilots  were  measured  under  two  failure 
stales.  The  first  was  a  '■simple"  single-engine  failure:  the  second  simulated  a  true  MRFV.S  mode  of  flight.  Piloting 
|>erformanoe  was  evaluated  using  a  variety  of  quantitative  measures  of  aircraft  flight  parameters  and  system  stales 
as  dependent  variables.  The  measures  were  obtained  from  the  ASPT  data  recording  system.  All  subjects  flew  the 
mission  profiles  under  all  experimental  conditions.  The  mission  profiles  were  developed  by  a  team  of  Tactical  Air 
Command  pilots  and  AFHRI./OT  instructor  pilot  personnel.  These  profiles  were  tailored  to  emphasize  the  unique 
skill  requirements  needed  to  fly  the  A-H)  in  the  MRFV.S  mode.  Fffort  was  also  devoted  to  testing  the  objective 
measures  of  pilot  performances  for  reliability  and  validity.  The  final  step  involved  the  use  of  a  test  pilot  from 
F.dwards  AFR  to  evaluate  the  MRFVS  simulation  and  to  verify  that  it  was  representative  of  the  actual  aircraft. 
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Subjects 


Twelve  TAC  pilots  front  Nellis.  Davis-Monthan.  and  Myrtle  Beaelt  AFB  were  used  as  subjects.  All  were 
qualified  as  "combat-ready"  and  had  inflight  experience  with  the  MRFC.S.  These  pilots  had  an  average  of  2.050 
total  flight  hours,  of  which  approximately  1.2(H)  were  in  fighler-lype  aircraft.  They  had  an  average  of  450  hours  in 
the  A- 10.  with  a  range  of  115  to  050  hours. 


Apparatus 

A  detailed  description  of  the  basic  ASPT  system  is  contained  in  ( ,\ rus  and  Fogarty  (1078).  The  A-10  has  two 
hvdraulie  power  svslems  which  are  pressurized  by  two  variable  delivery,  engine-driven  pumps.  The  left  hydraulic 
system  is  pressurized  by  the  left  engine  pump,  and  the  right  hydraulic  system  is  pressurized  by  the  right  engine 
pump.  Pump  delivery  is  a  function  of  engine  core  revolutions  per  minute.  I.oss  of  one  engine  results  in  partial  loss 
of  hydraulics.  The  fully  boosted  flight  control  system  becomes  a  manual  flight  control  system  when  all  hydraulic 
boost  is  lost. 

If  the  left  hydraulic  system  fails,  the  following  systems  are  inoperative:  flaps,  nosewheel  steering,  normal 
landing  gear  operation,  normal  brakes,  and  anti-skid.  If  the  right  hydraulic  system  fails,  the  slats,  slipway  door, 
and  deeelerons  are  inoperative.  In  addition,  the  auxiliary  landing  gear  accumulator  and  the  emergency  brake 
accumulator  will  not  he  recharged  and  the  slats  will  close  to  a  “fail  safe"  position.  Powered  control  of  both 
elevators,  both  ailerons,  and  one  rudder  is  retained  after  loss  of  either  hydraulic  power  source. 

Six  additions  to  the  basic  A-10  ASPT  configuration  were  required  in  order  to  develop  an  MRFCS  capability: 

1.  An  emergency  flight  control  panel. 

2.  A  stability  augmentation  panel. 

3.  A  hydraulic  control  stick  simulator. 

4.  Microcomputers  to  augment  the  hydraulic  control  stick  electronics. 

5.  A  software  program  for  the  central  computer  system. 

6.  An  increased  iteration  rate  for  the  central  computer  system. 

The  normal  A- 10  simulated  control  system  is  a  fully  hydraulically  boosted,  artificial  feel,  irreversible  control 
system  where  the  control  surface  actuators  absorb  all  the  aerodynamic  force  changes.  In  reverting  to  a  manual, 
reversible  control  system,  the  characteristics  of  the  control  system  in  all  three  axes  change  dramatically: 
consequently,  a  new  math  model  was  needed  to  simulate  pilot  control  input  and  control  surface  response.  This 
math  model  was  developed  from  wind  tunnel  and  flight  lest  data  to  faithfully  simulate  A-10  flight  characteristics. 
These  aircraft  flight  control  displacement  and  pressures  were  reproduced  in  the  ASPT. 

After  development  and  programming,  the  flight  dynamics  algorithms  were  loaded  into  the  updated  ASPT 
computer  system  which  had  a  30-hertz,  computational  iteration  rale.  This  speed  maintained  visual  control  loading, 
and  flight  parameter  fidelity.  It  also  permitted  the  communications  with  the  microprocessor  needed  to  accomplish 
proper  simulations  of  control  loading  using  the  programmable  control  —  loading  unit.  A  digital  programming 
approach  allowed  the  simulation  to  change  from  one  control-loading  program  to  another  almost  instantaneously: 
this  was  required  for  the  transition  from  normal  flight  to  manual  reversion  and  then  to  sustain  it. 


Simulated  Failure  Slates  and  Aircraft  Conditions 

With  two  engines  and  dual  hydraulic  systems,  the  A-10  can  suffer  a  number  of  failure  slates.  Table  I  shows 
the  engine/flight  control  conditions  which  result  in  normal  or  failure  stales.  The  MRKCS  modes  are  indicated  with 
an  asterisk.  However,  the  simulation  did  not  include  all  these  stales  or  the  dynamics  associated  with  transition  to 
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these  stales  because  the  probability  of  oceurrence  for  some  stales  is  low.  and  the  basic  questions  could  be  addressed 
by  an  investigation  of  more  limited  scojte. 


Table  I.  A- 10  Control  States 


Engine  Conditions* 


Hydraulic  System 

Conditions 

Both  Engines 
Operating 

Right  Engine 
Fails 

Left  Engine 
Fails 

Both  Engines 
Fail 

Roth  Hydraulic  System  Operating 

NS 

FS-I 

FS-2 

♦FS-3 

Right  Hydraulic  System  Fails 

FS-t 

FS-5 

*FS-<> 

♦FS-7 

Left  Hydraulic  System  Fails 

PS-8 

♦FS-0 

FS-10 

♦FS-11 

Both  Hydraulic  stems  Fail 

♦FS-12 

♦FS-13 

♦FS-I  1 

♦FS-I  5 

,lNS  -  Normal  Slate. 
l\S-K;iilur»*  Stale. 
♦MHFCS  Modes. 


The  aclual/MRFCS  failure  state  selected  was  FS-l  i.  An  engineering  analysis  supported  the  contention  that 
this  failure  state  was  representative  of  MRFCS  flight  conditions  and  also  gave  realistic  tasks  for  the  pilot  to  perform. 
At  failure  onset,  the  most  critical  parameters  (i.e..  aircraft  center  of  gravity  and  gross  weight),  as  established  from 
engineering  data,  placed  the  A-10  in  a  "sensitive"  MRFCS  envelope.  The  single-engine  failure  slate  selected  was 


FS-10. 


Study  Design 

In  order  to  produce  data  representative  of  real-world  operational  conditions,  it  was  necessary  to  plan  and 
conduct  a  complex  multifactor  experiment.  The  experimental  design  that  evolved  was  a  higher-order  multivariate 
repeated  measures  design.  This  design  was  the  most  economical  in  terms  of  resources  while  still  permitting  a 
complete  analysis  of  the  effects  under  investigation.  The  components  of  the  research  design  were  as  follows: 

I.  Independent  Variables.  Five  different  factors  were  used  as  independent  variables: 

a.  Field  of  View.  There  were  two  levels  of  this  variable:  the  ASPT  full  FOV  capability  (150  by  300 
degrees)  and  a  restricted  FOV  capability  (35  by  45  degrees). 

b.  Platform  Motion.  Two  levels  were  studied:  the  full  six-degrees-of -freedom  synergistic  platform  motion 
system  and  a  stationary  platform. 

In  all  simulator  configurations,  additional  force  cueing  was  provided  by  the  existence  of  g-seat/g-suit 
simulation.  All  simulator  configurations  provided  the  same  aircraft  instrument  displays  and  ambient  aircraft 
sounds. 


c.  Failure  Stales.  The  two  aircraft  failure  states  studied  involved  failure  of  the  left  engine.  In  one 
condition,  only  the  left  hydraulic  system  failed:  in  the  second  condition,  both  hydraulic  systems  failed.  The  second 
condition  simulates  a  true  MRFCS  mode.  In  both  conditions,  the  failed  engine  "windmilled." 

d.  Mission  Profiles.  In  terms  of  specific  piloting  tasks,  three  mission  profiles  were  flown,  but  all  three 
were  variations  from  a  very  basic  flight  pattern.  This  flight  pattern  consisted  of  takeoff,  climbing  turn,  cruise.  3g 
turn  (70-degree  bank),  descending  turn,  approach,  and  straight-in  landing.  There  were  three  failure  points  within 
this  profile.  The  first  malfunelion  could  occur  during  the  climbing  turn,  the  second  could  take  place  in  the  3g  turn, 
and  the  third  could  be  actuated  in  the  approach  (prior  to  lowering  flaps).  However,  only  one  failure  could  occur  per 
trial.  The  pilot's  objective  was  to  regain  total  aircraft  control  and  safely  land  as  quickly  as  possible,  therefore,  this 
procedure  was  viewed  as  producing  three  separate  inflight  control  tasks  that  tested  pilot  performance.  Because  of 


ils  obvious  criticality.  I  In-  landing  portion  of  tin-  flight  profib-  was  isolated  as  an  additional  task  and  separalrl\ 
analyzed,  figure  I  shows  the  eomplele  flight  profile. 
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Figure  I.  MRFCS  mission  profile. 


e.  Repetitions.  This  variable  is  a  measure  of  practice  effects,  or  learning.  Since  the  landing  portion  of  the 
mission  profile  was  viewed  as  a  separate  task,  this  could  be  analyzed  by  considering  each  subject  to  have  flown 
three  trials  under  identical  simulator  configurations  and  failure  states.  Three  repetitions  are.  of  course,  a  minimal 
number  of  trials  necessary  to  establish  a  learning  curve,  but  the  design  permitted  the  acquisition  of  these  training 
data,  and  they  provided  a  valuable  addition  to  the  research. 

2.  Dependent  V  ariables.  The  study  used  two  tvpes  of  dependent  variables.  The  first  type  was  comprised  of 
objective  measures  of  aircraft  flight  parameters  and  system  stale  values.  The  aircraft  flight  parameters  used  were 
hank  angle,  roll  rate,  pitch- angle,  pilch  rate,  vertical  velocity,  airspeed,  angle  of  attack,  runway  centerline 
deviation,  distance  from  runway  threshold,  and  altitude.  The  system  stale  values  were  related  to  the  amount  of 
stress  placed  on  the  aircraft.  The  variables  measured  were  positive  and  negative  g-toading  and  force  on  wheels. 

Of  these  12  quantitative  measures.  (t  were  used  to  measure  the  pilot's  control  of  the  aircraft  as  a  function  of 
the  inflight  point  of  failure.  Ten  were  used  to  measure  pilot  control  in  the  landing  portion  of  the  flight  profile. 
These  dependent  variables  were  unweighted  for  both  the  inflight  and  landing  tasks.  Table  2  lists  these  variables, 
shows  what  measurement  set  they  were  used,  and  gives  their  ASPT  physical  definition. 
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Tahir  Listing.  l  tili/alion  ami  Definition  of  (Quantitative  V  ariables 


\«tri<il>lr  Ubi'l 

1  liii/atiofi 

Definition 

Roll  Rate 

Inflight.  Landing 

Radians/second  about  airerafl 
(  \< '.)  \-a\i* 

Pilch 

J/dli^diL  l  anding 

e  degrees  from  horizontal  flight 

Pilch  Rate 

Inflight.  Landing 

Radians/seeond  about  \< !  \-a\is 

\  erlical  \  elocilx 

Inllight.  Landing 

leet/seeond  clraiiffr  in  altitude 

\irspeed 

Inflight.  Landing 

Knots  indiealed  airspeed 

Normal  Force 

Landing 

Pressure  in  pounds  on  wheels 

\ngle  ol  Altaek 

Inflight.  Landing 

\ujjle  in  degrees  between  \< . 
w i ii ji  chord  and  W  ’ 
veloeilx  vector 

( enterline  Deviation 

Landing 

1  >e\  ialion  in  feet  from 

runway  centerline 

1  Runway 

Landing 

Distance  in  leel  from  end  of 
runwav  marker 

Vltilude 

Inflight 

Mlitilde  in  feel  above  ground  level 

g  Load 

Inflight 

+  g-loading  on  \F 

Rank  Angle 

Inflight.  Landing 

+  degrees  about  AF  \-avi- 

For  inlliglit  eontrol  task-.  if measures  were  sampled  at  a  rate  of  .'it t  times  per  seeond.  and  a  root  mean 

square  (RMS)  value  wa-  eninpuled.  II..-  RMS  was  seleeled  as  the  most  appropriate  statistie  lieeause  it  easilv 
accommodates  positive  amt  negative  values  and  is  sensitive  to  (and  reflective  of)  extreme  deviations  from  1 1  if 
central  tendency  in  a  distribution  of  numbers.  Tile  same  was  true  for  tin-  landing  portion  of  the  mission  with  the 
exception  of  force  on  wheels  and  distance  down  runwav  These  variables  were  measured  bv  capturing  total  values 

V  final  bit  of  objective  data  collected  during  the  study  dealt  with  simulator  "crashes."  The  crashes  were 
instances  when  a  total  loss  of  aircraft  control  occurred  while  the  pilot  was  transitioning  to  or  landing  under  the 
MUFFS  mode  of  flight. 

In  addition  to  the  objective  measures  just  discussed,  subjective  measures,  based  on  questionnaire  data,  were 
also  obtained.  \t  the  conclusion  of  the  experimental  trials,  the  subjects  were  administered  a  set  of  forms  on  which 
they  evaluated  the  importance  and  adequacy  of  the  visual  and  force  cues  used  in  the  simulation. 


Study  Procedures 

Initially,  the  subjects  were  briefed  as  to  the  objectives  and  conduct  of  the  study,  a  short  simulator  "safety" 
course  was  given,  and  cockpit  strap-in  procedures  were  demonstrated.  Each  subject  then  received  a  training  session 
in  ASPT  prior  to  participation  in  (he  actual  study.  This  training  consisted  of  two  flights  (essentially  expanded 
traffic  patterns  as  can  be  seen  from  Figure  1 1  which  familiarized  the  pilot  with  ASPT  characteristics  and  the 
mission  profile  to  be  flown  (see  Appendix  F).  The  ASPT  was  in  a  normal  A-10  configuration.  In  the  studv  proper, 
each  subject  "flew"  three  missions  under  four  simulator  configurations  and  two  failure  stales.  Consequently,  there 
was  a  total  of  24  trials  for  each  subject.  The  order  of  presentation  of  these  trials  was  randomized  (to  avoid 
systematic  learning  or  practice  effects)  and  administered  over  a  2-day  period  (12  trials  per  day  in  blocks  of  (»).  At 
the  conclusion  of  the  experimentation,  each  subject  completed  the  questionnaires  and  was  debriefed. 


Data  Analysis 

For  the  objective  measures  of  aircraft  control,  the  statistical  model  used  was  a  five-factor  multivariate  analvsis 
of  variance  with  repeated  measures  on  subjects.  This  2x2x2x3x12  design  was  convenient  for  analyzing  both  the 
inflight  and  landing  data.  The  same  design  was  used  to  analyze  each  dependent  variable  by  means  of  a 
univariate  analysis  of  variance,  thus  producing  0  additional  analyses  for  the  inflight  data  and  10  for  the  landing 
data. 
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The  actual  data  computations  were  done  on  the  1  NIVAC  1 1  OH  at  the  Air  Force  Human  Resources  Laboratory. 
The  program  used  was  a  modification  of  the  BMDX69  program,  which  performs  a  multivariate  analysis  of  variance 
or  covariance  for  any  hierarchical  design  with  equal  cell  sizes.  This  included  nested,  partially  nested  and  crossed, 
and  fully  crossed  designs.  The  program  also  performed  univariate  tests  for  each  dependent  variable.  The  "crash 
data  were  not  statistically  analyzed  and  are  reported  only  in  tabular  form.  The  questionnaire  data  were  analyzed  by 
using  median  rating  values  to  estimate  central  tendencies  and  then  applying  chi-square  techniques.  The  level  of 
significance  for  all  statistical  tests  was  set  at  the  95  percent  level  of  confidence  (p  <  .05). 

III.  RKSl’I.TS 

The  analvses  of  the  quantitative  data  collected  during  the  simulated  flights  are  discussed  in  the  first  three 
parts  of  this  section.  The  first  part  deals  with  the  inflight  failure  point  data,  the  second  with  the  landing  data,  and 
the  third  with  the  "crash”  data.  The  fourth  part  of  this  section  is  concerned  with  the  summary  and  analysis  of  the 
questionnaire  data. 

As  described  in  the  previous  section,  a  repealed  measures  design  was  used  to  analyze  the  inflight  and  landing 
data.  For  the  inflight  analvsis.  the  components  in  the  design  were:  2  FOYs  \  2  PM  Conditions  x  2  Failure  .States  x  5 
failure  Points  x  12  pilots.  The  design  components  for  the  landing  analysis  were  2  FOVs  x  2  PM  Conditions  x  2 
Failure  Slates  x  ,'t  Trials  x  12  pilots.  The  two  sets  of  data  were  subjected  to  both  multivariate  and  univariate 
analvses  of  variance. 


Analysis  of  the  Inflight  Tasks  Data 

F.ngine  failures  were  initiated  at  three  points  in  the  flight  profile:  in  the  climbing  turn,  in  the  3g  turn,  and  in 
the  approach.  Nine  dependent  variables  were  used  to  assess  pilot  performance  on  these  inflight  tasks.  Table  A  is  an 
abbreviated  listing  of  the  results  of  the  multivariate  analysis. 

Table  5  shows  that  there  were  significant  main  effects  for  the  FOV.  the  Failure  State,  the  Failure  Point 
(Tasks),  and  Subjects.  Because  individual  differences  were  not  of  interest  in  the  study,  no  subject  effects  or 
subject-related  interactions  are  discussed.  The  PM  main  effect  was  not  significant.  There  were  significant 
interactions  between  FOV  and  Failure  Point.  Failure  Stale  and  Subjects,  and  Failure  Point  and  Subjects.  From  the 
multivariate  analvsis.  it  may  lie  concluded  that  in  the  simulator  (a)  the  full  FOV  enhances  performance,  (b)  the 
MRFCS  failure  stale  results  in  poorer  performance,  (c)  maintaining  aircraft  control  in  the  5-G  turn  is  more  difficult 
than  in  the  climbing  turn  or  the  approach,  and  (d)  the  restricted  FOV  is  particularly  damaging  to  pilot  performance 
when  the  failure  occurs  in  the  Hg  turn. 

The  main  effect  means  for  each  dependent  variable  used  in  the  analysis  of  the  inflight  data  are  listed  in 
Appendix  A.  To  determine  how  each  dependent  variable  was  affected  by  the  experimental  conditions,  nine 
univariate  analvses  of  variance  were  performed.  The  design  was  the  same  2x2x2x.<xl2  paradigm  used  in  the 
multivariate  analvsis.  In  condensed  format,  the  significant  sources  of  variance  and  their  associated  probability 
levels  are  given  in  Table  t. 
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I'oUIr  I.  Statistically  Significant  Components  From  the 
I'nivariate  Analyses  of  Variance  for  Inflight  Scores 


Variable 

Significant  Source  of  Variance 

Probability 

Roll  Kate 

FO\ 

.01 

Failure  Point 

.01 

FOV  \  Failure  Point 

.0,5 

Pitch 

FOV 

.02.') 

Failure  Stale 

.01 

Failure  Point 

.01 

FOV  \  PM 

.023 

I’ilcli  Kate 

Failure  Stale 

.01 

Failure  Point 

.01 

\  rrhral  \  rloril\ 

FOV 

.025 

Failure  Stale 

.01 

Failure  Point 

.01 

Virspeed 

Failure  State 

.01 

Failure  Point 

.01 

\nglc  of  \llack 

FOV 

.05 

Failure  Stale 

.01 

Failure  Point 

.00 

V  It  it udr 

PM 

.025 

Failure  Point 

.01 

g-l.oad 

FOV 

.01 

Failure  Stale 

.01 

Failure  Point 

.0) 

Rank  \uglc 

FOV 

.01 

Failure  Stale 

.05 

Failure  Point 

.01 

FOV  \  Failure  Slate 

.01 

FOV  \  Failure  Point 

.01 

From  the  univariate  analyses  summarized  in  Tahir  I  the  following  conclusions  are  warranted: 

1.  For  the  Roll  Rate,  the  full  FOV  facilitates  pilot  control.  Control  is  most  difficult  when  failure  occurs  in  the 
3g  turn.  The  FOV  X  Failure  Point  interaction  shows  that  the  large  FOV  is  particularly  beneficial  for  maintaining 
control  during  failures  in  3g  turns  (most  difficult)  and  the  approach  (medium  difficult). 

2.  For  Pitch,  the  full  FOV  and  simple  failure  condition  allows  better  control.  Control  is  most  difficult  when 
failure  occurs  in  the  3g  turn.  The  FOV  X  PM  interaction  indicates  that  the  presence  of  PM  degrades  performance 
with  a  restricted  FOV  but  improves  it  with  a  full  FOV. 

3.  For  Pitch  Rate,  the  main  effects  of  Failure  State  and  Failure  Point  are  the  same  as  those  found  for  Pitch. 

4.  For  Vertical  Velocity,  the  main  effects  are  the  same  as  those  found  for  Pitch. 

5.  For  Airspeed,  the  main  effects  are  the  same  as  those  found  for  Pitch  Rate. 
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ft.  For  Angle  of  Attack,  the  main  effects  are  the  same  as  those  found  for  Pitch  and  Vertical  Velocity. 

7.  For  Altitude,  the  no  PM  condition  produced  better  pilot  control.  The  significance  of  this  variable  at  Failure 
Point  is  a  necessary  .experimental  artifact  produced  by  the  flight  priWiles  flown  (i.e.,  failures  were  programmed  to 
occur  at  different  altitudes). 

8.  For  g-Load.  the  main  effects  are  the  same  as  those  found  for  Pitch.  Vertical  Velocity,  and  Angle  of  Attack. 

0.  For  Bank  Angle,  the  main  effects  are  the  same  as  those  found  for  Pitch.  Vertical  Velocity,  Angle  of  Attack, 
and  g-Load.  The  FOV  X  Failure  State  interaction  indicated  that  the  restricted  FOV  is  tremendously  disruptive  of 
hank  control  in  the  true  MRFCS  failure.  The  FOV  X  Failure  Point  interaction  shows  that  the  full  FOV  is  highly 
beneficial  to  control  of  bank  for  a  MRFCS  failure  in  the  approach:  but  control  of  bank  is  so  poor  when  there  is 
either  a  single  engine  or  MRFCS  failure  in  a  3g  turn  that  variations  in  FOV  had  no  effect. 


Analysis  of  the  (.adding  Task  Data 

Karh  subject  performed  three  landings  under  identical  simulator  and  Failure  Stale  configurations.  Ten 
dependent  variables  were  used  to  assess  pilot  performance  in  the  landing  task.  Table  5  is  an  abbreviated  listing  of 
the  results  of  the  multivariate  analvsis  and  shows  that  there  were  significant  main  effects  for  (a)  FOV.  (b)  Failure 
Stale.  (<•)  Trials  (number  of  times  that  the  landing  was  repealijjl).  and.  (d)  Subjects.  The  PM  main  effect  was  not 
significant.  The  onlv  significant  interaction  was  between  Failure  Stale  and  Subjects.  From  the  multivariate  analy  sis 
of  the  landing  data  it  mav  he  concluded  that  (a)  the  full  FOV  enhances  landing  performance,  (h)  lauding  in  the 
MRFCS  mode  is  more  difficult,  and  (c)  practice  improves  the  pilot's  skill  in  landing.  The  main  effect  means  for 
each  dependent  variable  used  in  the  analysis  of  the  landing  data  are  listed  in  Appendix  R. 

Table  .7.  Listing  of  Results  of  Multivariate  Analysis  of  Variance 
for  the  Landing  Task 


Sourer  of  \  ariution 

Probabilh 

»« »\ 

.no* 

I’M 

.50 

Failure  Stale 

.(HI* 

Trials 

0t* 

Subject* 

.00* 

F<>\  \  I’M 

.85 

FOV  \  f  ailure  Slate 

,l«> 

I’M  X  f  ailure  State 

.7  h 

FOV  \  Trials 

.15 

I’M  \  t  rials 

.00 

f  ailure  Stale  \  Trials 

.  1  < 

KOV  \  Subjec  ts 

.10 

I’M  \  Suhjeels 

1 .00 

f  ailure  State  \  Subjects 

.05* 

Trials  \  Subjec  ts 

.12 

FOV  \  I’M  \  Failure  Stale 

.02 

FOV  \  PM  \  Trials 

.81 

KOV  \  Failure  Slate  X  Trials 

Of 

I’M  \  Failure  Stale  \  Trials 

.81 

FOV  X  PM  X  Subjeets 

.07 

FOV  \  Failure  Stale  X  Subjects 

r* 

I’M  X  Failure  Stale  X  Subjects 

15 

l  <  >V  X  Trials  X  Subjeets 

72 

I* VI  X  Trials  X  Subject* 

.08 

Failure  Slate  \  Trials  X  Subjeets 

.18 

FOV  X  PM  X  Failure  Stale  X  Trials 

.00 

f  OV  X  I'M  X  f  ailure  Stale  \  Suhjeels 

.05 

FOV  X  I'M  X  Suhjeels 

.% 

FOV  X  Failure  Stale  X  Trials  X  Subjec  ts 

.<>5 

I'M  X  Failure  Sl.Me  X  Trials  X  Subjec  ts 

.05 

•  Sljlstiulh  ant  at  I tlr  m|  mrril  Iced  of  rolifitirmr  (ji  <  .O.il 


It 


Iv 


\ 


Ten  univariate  analyses  «f  variance,  one  for  eaelt  dependent  variable,  were  performed.  The  design  was  t lie 
same  2x2x2x3x12  paradigm  used  in  I  lie  multivariate  analysis.  As  in  the  inflight  analyses,  only  the  significantly 
different  sources  of  variation  are  shown  in  Table  ft.  From  the  univariate  analyses,  the  following  conclusions  are 
warranted: 


Table  <>.  Statistically  Significant  Components  from  the 
Li ni variate  Analysis  of  Variance  for  Landing  Scores 


Variable 

Signifirant  Sourer  of  Variant* 

Probability 

Roll  Ran- 

FOV 

.01 

Failure  Slate 

.02.") 

Trials 

.01 

FOV  \  Trials 

.03 

Pilch 

FOV  \  l»M  \  Trials 

.03 

Pilch  Hale 

FOV 

.03 

Failure  Stale 

.01 

Trials 

.01 

Vertical  Velocity 

FOV 

.03 

Failure  Stale 

.023 

T  rials 

.01 

FOV  \  Trials 

.03 

Air  Speed 

Trials 

.023 

Normal  Force 

None 

- 

Angle  of  Attack 

FOV  \  PM  \  Trials 

.01 

Centerline  Deviation 

None 

- 

Distance  Threshold 

None 

- 

Hank  Angle 

FOV 

.01 

Failure  Slate 

.01 

I.  For  the  Roll  Rate,  the  full  FOV  and  the  simple  failure  facilitate  pilot  control,  landing  skill  improves  as  a 
function  of  practice.  The  FOV  X  Trials  interaction  shows  that  the  rate  of  control  improvement  was  greater  with  a 
large  FOV. 

2.  The  higher  order  interaction  for  Pitch  indicates  that,  in  conjunction  with  the  large  FOV.  PM  has  a 
beneficial  effect  on  performance,  except  for  the  second  trial  in  the  small  FOV  condition. 

3.  For  Pitch  Rate,  the  main  effects  are  the  same  as  those  found  for  Roll  Rate. 

4.  For  Vertical  Velocity  the  main  effects  are  the  same  as  those  found  for  Roll  Rate  and  Pitch  Rate.  The  FOV 
X  Trials  interaction  is  interpreted  as  for  Roll  Rate,  above. 

5.  For  Airspeed,  the  data  show  that  it  decreased  as  a  function  of  increasing  practice. 

6.  The  Normal  Force  on  wheels  dependent  variable  did  not  show  any  significant  differences. 

7.  When  Angle  of  Attack  is  considered,  one  higher-order  interaction  is  significant.  The  FOV  X  PM  X  Trials 
interaction  indicates  that,  although  the  combination  of  a  large  FOV  and  PM  generates  a  condition  that  favors 
superior  control;  under  these  conditions,  repeated  practice  did  not  improve  the  pilot's  ability. 

8.  The  Centerline  Deviation  dependent  variable  did  not  show  any  significant  differences. 
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9.  The  Distance  Threshold  dependent  variable  did  not  show  any  significant  differences. 

10.  For  Bank  Angle,  the  main  effects  for  FOV  and  Failure  State  are  the  same  as  those  found  for  Roll  Rale, 
Pitch  Rate,  and  Vertical  Velocity. 

Crash  Data 

The  crash  data  also  provide  evidence  of  control  mode  differences  and  pilot  learning,  hut  since  a  "crash"  is  an 
all-nr-none  occurrence,  these  effects  must  be  viewed  in  an  absolute  and  discrete  sense.  Table  7  presents  the  mean 
number  of  crashes  per  pilot  at  various  stages  of  practice.  The  data  in  this  table  illustrate  the  difficulty  of  flight 
control  in  (he  MRFCS  mode.  The  effects  of  practice  are  also  well  portrayed.  The  last  entry  in  Table  7  points  up  a 
lesson  learned  in  the  study.  A  pilot,  no  matter  how  skilled  or  confident,  should  never  "sideslip"  an  A- 10  in  the 
MRFtlS  mode  to  make  a  landing. 


Table  7.  Mean  Crashes  Observed  for  Subjects 


Performance  Perii»d 

Crashes  per  Pilot 
in  Simple  Failure 

Mode 

Crashes  per 
Pilot  in 
MRFCS  Mode 

1.  First  Session  (Trials  1-6) 

.(Ml 

.87 

2.  Second  Session  (Trials  7-12) 

.00 

.33 

7.  ■  Third  Session  (Trials  17-18) 

.00 

.00 

1.  Fourth  Session  (Trials  10-21) 

.00 

.08 

Analvsis  of  the  Questionnaire  Data 

The  purpose  of  the  questionnaires  (see  Appendix  D)  was  to  provide  information  that  would  supplement  the 
data  recorded  during  the  actual  simulator  flights.  The  nature  of  such  information  is  highly  subjective,  but  it  was 
believed  that,  bv  providing  a  forum  where  the  pilots  could  express  opinions  about,  and  ratings  of.  the  ASPT 
MRFCS  simulation,  other  dimensions  of  measurement  could  be  added  to  the  research.  The  content  of  the 
questionnaires  may  be  subdivided  into  open-ended  queries  and  rating  scales.  The  open-ended  questions  were 
quite  general  and  dealt  with  simulation  "realism"  and  task  difficulty.  The  rating  scales  were  used  to  obtain  data  on 
simulator  handling  qualities  and  the  training  value  of  MRFCS  practice  in  the  four  simulator  configurations  studied. 
It  was  possible  to  perform  simple  statistical  analyses  of  these  data. 

Simulator  Handling  Qualities:  The  handling  qualities  of  the  simulator  were  evaluated  for  both  normal  and 
MRFtiS  flight  conditions.  These  evaluations  were  performed  by  the  pilots  using  a  five-point  rating  scale  in  which  a 
1  was  "loo  sensitive”,  a  .1  was  "like  aircraft",  and  a  .7  was  "loo  heavy.”  In  summarizing  the  results,  the  median 
value  of  these  ratings  (rounded  to  the  nearest  .7)  was  chosen  as  the  statistic  most  descriptive  of  the  central  tendency 
shown  in  the  data. 

Table  8  gives  median  ratings  of  the  A- 10  ASPT  simulation  in  normal  flight  conditions.  With  the  exception  of 
being  rated  as  slightly  heavy  in  pilch  for  the  takeoff  and  climbing  turn,  it  can  be  seen  that  the  simulation  was 
perceived  by  the  pilots  as  acceptably  realistic. 


Table  8.  Median  Ratings  of  ASPT  Simulation  in  Normal  Flight 


Maneuver 

Aircraft  Axis 

Pill'll 

Roll 

Yaw 

Takeoff  and  (llimhing  Turn 

3.5 

3.0 

3.0 

3g  Turn 

3.0 

3.0 

3.0 

Landing 

3.0 

3.0 

3.0 

The  information  in  Table  0  parallels  that  in  Table  8.  but  the  ratings  in  Table  0  are  assessments  of  the  .4-10 
simulation  in  the  MRFCS  mode.  The  median  ratings  assignrd  by  the  pilots  indicate  that  the  control  feel  of  the 
MRFCS  simulation  was  also  acceptable. 


lb 


-  r» 


{ 
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Table  V.  Median  Ratings  of  ASPT  Simulation  in  MRFCS  Mode 


Maneuver 

Aircraft  Axis 

Pilch 

Roll 

Yaw 

Takeoff  and  Climbing  Turn 

3.0 

3.0 

3.0 

3g  Turn 

3.0 

3.0 

3.0 

Landing 

3.0 

3.0 

3.0 

As  the  final  part  of  the  first  questionnaire,  the  pilots  were  asked  to  rale  their  ability  to  maintain  desired 
control  of  pitch,  roll,  and  yaw  coordinates  w  hile  in  the  MRF’C.S  flight  mode.  The  rating  seale  used  ran  front  I  (very 
well)  to  5  (very  poorly).  A  listing  of  the  results  (rounded  as  before)  is  presented  in  Table  10.  These  data  show  that 
on  the  average  the  pilots  felt  they  were  able  to  maintain  reasonable  control  of  these  aircraft  flight  parameters 
during  the  execution  of  the  three  maneuvers. 


Table  10.  Median  Ratings  of  Simulator  Control  Ability 
in  MRFCS  Mode 


Ability  to  Maintain 

Maneuver 

Pilch  Angle 

Roll  Kate 

Yaw  Stability 

Climbing  Turn 

2.5 

2.5 

3.0 

3g  Turn 

3.0 

2.5 

3.0 

Landing 

3.0 

3.5 

3.5 

Training  Value  of  Simulator  Configurations 

There  were  four  ASPT  configuralions:  full  FOV  and  PM. 

full  FOV  and  no  PM.  limited  FOV  and  PM.  and 

limited  FOV  and  no  PM.  Csing  a  five-point  seale  (1  equals  poor 

;  5  equals  excellent),  the  pilots  rated  the  value  of 

these  four  configuralions  for  training  the  three  inflight  tasks.  The  results  of  this  evaluation  (rounded  to  the  nearest 

.5)  are  shown  in  Table  1 1. 

As  the  table  shows,  the  ASPT  in  the 

full  FOV.  PM  condition  was 

rated  as  a  very  good 

medium  for  training  the  selected  tasks.  The  full  FOV.  no  PM  configuration  gave  fair  training,  but  the  remaining 

two  conditions  were  rated 

as  rather  "poor." 

Table 

II.  Median  Ratings  of  Training  Value  of  ASPT  Configuration 

Maneuver 

ASPT  Configuration 

Climbing  Turn 

3(1  Turn 

Approach 

Full  FOV;  PM 

1.0 

1.0 

1.5 

Full  FOV:  Vo  PM 

3.5 

3.0 

3.5 

Limited  FOV:  PM 

2.0 

1.5 

2.0 

Limited  FOV:  Vo  PM 

2.0 

1.5 

2.0 

Chi-square  analysis  isolated  the  critical  simulator  configuration  component.  Table  12  reproduces  the  actual 
ratings  observed.  (Ratings  were  collapsed  into  three  categories  to  avoid  small  expected  cell  frequencies.)  When  the 
chi-square  statistical  analysis  was  run  on  the  data  in  the  table  the  product  was  a  value  of  87.63.  With  six  degrees  of 
freedom,  a  value  of  12.60  is  significant  at  the  95  percent  level  of  confidence.  Thus  it  could  be  concluded  that  there 
was  a  reliable  difference  in  rated  training  value  as  a  function  of  ASPT  configurations.  To  determine  whether  this 
difference  was  the  result  of  visual  or  motion  cueing  conditions,  two  additional  analyses  were  required. 
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Table  12.  ASPT  Configuration  Training  Value  Ratings 


1 


Obsrrved  Number  mid  ( 4tli*|iiirirk  of  Haling 


ASPT  4  ion  figuration 

4  iairgort 

1  and  2 

4  -ategor* 

:i 

4  alt'fton 

1  and  •» 

Full  FOV.  PM 

3 

12 

21 

Full  FOV.  No  PM 

i 

20 

i:> 

l  imited  FOV.  PM 

■>- 

a 

i 

Limited  FOV.  No  PM 

20 

0 

i 

To  investigate  visual  rue  effects.  Table  1 3  recombines  the  data  from  Table  12  while  equalizing  motion  rues. 
Prom  the  analysis  of  tile  data  in  Table  Id.  a  chi-square  value  of  83.52  was  obtained.  With  two  degrees  of  freedom, 
the  critical  value  at  the  05  percent  level  of  eotifidenee  equals  h.O.  Ohviouslv.  the  full  FOV  was  rated  as  vielding 
significantly  better  training  than  did  the  limited  KOY. 


Table  12.  ASPT  Visual  Configurations  Training  Value  Ratings 


Number  and  4!alegorie*  of  Rating* 

(idlt'gorv 

41alegor> 

(  ialegort 

\SI»T  Configuration 

1  and  2 

:t 

>  and  ."> 

Full  FOV 

f 

32 

Mi 

Limited  FOV 

1  1 

2 

The  data  in  Table  12  were  also  used  to  determine  if  platform  motion  was  viewed  as  improving  training.  In  this 
ease,  the  FOY  conditions  were  equalized.  Table  1  I  presents  the  data  used  for  ibis  analysis.  The  chi-square  analysis 
produced  a  value  of  1.72  which,  with  two  degrees  of  freedom,  was  not  significant  at  the  required  level  of 
confidence.  Thus  the  presence  or  absence  of  platform  motion  did  not  affect  the  rating  of  training  value. 


Table  14.  ASPT  Motion  Configurations  Training  Value  Ratings 


Number  and  Categories  of  Ratings 

4ialegor\ 

4ialegor% 

(ialegorv 

ASPT  4.nufiguraitnn 

1  and  2 

:t 

l  and  •> 

PM 

30 

20 

22 

No  PM 

30 

21) 
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O/ien-entleil  (Questions:  The  questionnaire  contained  three  open-ended  items.  To  quote  every  comment  in  its 
entirely  would  be  much  loo  repetitious,  so  onlv  the  essence  of  these  statements  is  reported. 

Item  One.  //on  realistic  </n  you  feel  the  simulation  of  manual  reversion  teas  in  this  study  !  The  main  themes 
of  It.e  pilots'  res|Hinses  to  ibis  question  were  as  follows:  "verv  realistic"  ..."  \SPT outstanding"  .  .  .  "pretty  good, 
controls  not  stiff  enough"  . .  .  "motion  and  full  FOY  gave  valuable  training"  . . .  "think  it  was  good"  . . .  "very  good 
with  full  FOV  ami  motion"  .  .  . 

Item  Two.  l  ist  any  difficulty  you  encountered  in  flying  under  the  various  simulation  modes.  He  as  sfterifir  as 
/mssible.  The  principal  items  mentioned  were  as  follows:  "small  FOV"  .  .  .  "slopping  aircraft  on  runway  with  no 
brakes"  .  .  .  "brakes  squirrelly"  .  .  .  "poor  ground  handling  characteristics"  .  .  .  "motion  bad  no  effect"  . .  .  "small 
FOV  meant  instrument  flight"  .  .  .  "motion  did  not  appear  to  enhance  or  degrade"  .  .  .  "did  not  notice  motion 
difference”  .  .  . 
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Item  Three.  General  Comments.  The  following  were  the  major  points  given  in  answer  to  this  item:  "single 
engine  MRF(',S  would  he  rare,  but  two  engine  training  would  be  good"  .  .  .  "full  FOV  gives  realistic  training,  small 
FOV  is  an  impossible  task"  .  .  .  "motion  unnecessary"  .  .  .  "simulator  convinced  me  that  aircraft  can  be  flown  in 
MRF(’.S“  .  .  .  "big  improvement  in  my  performance  after  three  hours  of  training"  .  .  .  "overall,  it  was  a  good 
learning  experience"  .  .  . 

I\.  msci  ssioN 

The  primary  objective  of  this  study  was  to  provide  information  on  the  effects  of  certain  flight  simulator  cue 
conditions  and  simulated  aircraft  states  on  pilot  performance.  However,  it  became  apparent  that,  in  addition, 
information  concerning  the  effects  of  practice  on  the  acquisition  of  a  skill  "untrained"  in  the  aircraft  was  of  at  least 
equal  importance.  In  fact,  this  second  aspect  of  the  study  may  have  the  greatest  significance  in  the  long  run. 

The  findings  of  this  study  have  expanded  the  human  factors  data  base  on  cue  requirements  for  aircraft 
simulation.  But  a  lengthy  discourse  on  the  importance  of  FOV  and  the  impotence  of  PM  (for  simulator  training  for 
an  essentially  centerline-thrust  aircraft)  would  add  little  to  the  existing  literature.  Flying,  as  normally  performed 
in  an  aircraft,  is  visually  oriented  for  both  contact  and  "instrument"  flight  conditions.  In  the  contact  realm,  the 
question  of  "How  much  visual  simulation  is  enough?"  can  be  definitively  answered  only  through  costly  and 
painful  iterations.  However,  it  is  generally  accepted  that  the  general  principle  "more,  with  greater  realism"  is 
usually  better.  At  the  same  lime,  it  must  be  remembered  that  in  this  study  the  smaller  FOV  was  judged  to  have 
some  positive  training  value.  Practice  under  this  condition  did  improve  performance.  The  small  FOV  did  make  the 
task  more  difficult  but  there  is  little  doubt  that  control  of  the  simulated  aircraft  in  the  MRFCS  mode  can  be  learned 
(albeit  with  great  difficulty)  with  a  small  FOV. 

The  fact  that  PM  cueing  did  not  significantly  influence  pilot  performance  in  the  simulator  is  not  surprising.  As 
noted  earlier.  PM  does  not  seem  to  play  an  important  role  in  the  simulation  of  centerline-thrust  jet  aircraft.  The 
present  study  provides  further  confirmation  of  these  previous  findings. 

If  the  improvement  in  pilot  skill  occurring  as  a  function  of  performing  tasks  in  the  ASPT  transfers  to  the  A- 10 
(as  if  should),  fhe  study  may  be  interpreted  as  a  successful  example  of  a  simulator  training  application.  Obviously, 
if  the  pilot's  capability  to  perform  MRFCS  and  single-engine-related  flight  control  tasks  had  not  improved,  serum., 
doubts  would  have  been  cast  on  the  validity  of  the  research. 

The  distinctive  feature  of  this  study  is  that  the  task  performed  in  the  simulator  is  one  that  will  probably  never 
be  realistically  trained  or  practiced  in  the  aircraft.  Although  an  A-10  pilot  might  briefly  “switch  on"  the  MRFTS 
while  in  straight-and-level  flight  (when  at  safe  altitude  in  some  advanced  phase  of  training),  this  is  not 
representative  of  the  real  world  of  MRFCS  employment  and  may  be  of  dubious  training  value.  Although  many 
emergency  pilot  actions  are  trained  in  devices  other  than  the  airrraft  itself,  in  the  majority  of  cases  this  training 
deals  only  with  procedures  and  not  with  the  development  of  motor  skill  sequences.  Thus,  for  the  A-10  pilot,  it 
appears  likely  that  his  proficiency  in  the  MRFCS  mode  will  be  developed  and  tested  in  the  simulator.  I  nder  these 
circumstances,  the  simulator  is  both  training  device  and  criterion  vehicle.  It  is  this  facet  of  the  studv  that,  in  large 
measure,  may  make  it  a  benchmark  for  future  work. 

V.  CONCLUSIONS 

Because  the  data  analyses  produced  such  clear-cut  results  unconfounded  by  complex  interactions,  drawing 
conclusions  from  the  study  is  a  simple  process.  When  reduced  to  its  basics,  the  research  may  be  viewed  as 
investigating  simulator  configurations,  piloting  tasks,  and  practice  effects.  The  findings  related  to  each  of  these 
three  areas  may  be  succinctly  summarized. 

I.  For  simulator  configurations  and  the  A-10  failure  stales,  it  was  found  that 

a.  The  large  FOV  consistently  provided  an  environment  in  which  the  pilot's  control  of  the  simulated 
aircraft  was  significantly  superior  to  control  under  small  FOV  conditions. 


b.  With  g-seal  and  g-suit  force  cueing  present,  the  addition  of  the  six  degrees  of  freedom  PM  system  did 
not  improve  the  pilot’s  control  of  the  aircraft. 

2.  For  piloting  tasks,  the  study  produced  two  very  logical  results: 

a.  After  an  engine  failure,  maintaining  control  in  the  MRFCS  mode  is  more  difficult  than  in  a  non-MRFCS 

mode. 

b.  After  an  engine  failure,  maintaining  control  while  in  a  3g  turn  is  a  harder  task  than  when  the  failure 
occurs  in  a  climbing  turn  or  in  a  normal  approach. 

3.  The  data  from  landings  practiced  under  the  same  failure  state  and  simulator  configurations  show  that  A-10 
pilots  can  be  trained  to  maintain  adequate  control  and  land  in  MRFCS  flight  modes  as  well  as  in  simple  single- 
engine-failure  flight  modes. 


20 


BIBLIOGRAPHY 


Bock,  R.D.  Multivariate  statistical  methods  in  behavioral  research.  New  York:  McGraw-Hill.  1975. 

Cyrus,  M.L.,  &  Fogarty,  L,  Advanced  simulation  for  neui  aircraft.  Proceedings  of  the  11th  NTEC/lndustry 
Conference.  1978,  11.  103-108. 

Gray,  T.H.,  Chun,  E.K.,  Warner,  H.D.,  &  Eubanks,  J.L.  Advanced  flight  simulator:  Utilization  in  A-10 
conversion  and  air-to-surface  attack  training.  AFHRL-TR-80-20.  AD-A094  608.  Williams  AFB.  AZ: 
Operations  Training  Division,  Air  Force  Human  Resources  Laboratory.  January  1981. 

Gum,  D.R.,  Albery,  W.B.,  A  Basinger,  J.D.  Advanced  simulation  in  undergraduate  pilot  training:  An  overview. 
AFHRL-TR-75-59(l),  AD-A030  224.  Wright-Patterson  AFB.  OH:  Advanced  Systems  Division.  Air  Force 
Human  Resources  Laboratory.  December  1975. 

Jones,  L.V.  Analysis  of  variance  in  its  multivariate  developments.  In  R.  B.  Cattel  (Ed.).  Handbook  of  multivariate 
experimental  psychology  (Chapter  7).  Chicago:  Rand  McNally.  1966. 

Kron,  G.J.  Advanced  simulation  in  Undergraduate  Pilot  Training.  AFHRL-TR-75-59(III).  Af  -A017  468.  Wright- 
Patterson  AFB.  OH:  Advanced  Systems  Division.  Air  Force  Human  Resources  Laboratory.  October  1975. 

Martin,  E.L.,  Training  effectiveness  of  platform  motion:  Review  of  motion  research  involving  the  advanced 
simulator  for  pilot  training  and  the  simulator  for  air-to-air  combat.  AFHRL-TR-79-51 .  AD-A095  930. 
Williams  AFB.  AZ:  Operations  Training  Division.  Air  Force  Human  Resources  Laboratory.  February- 
1981. 

Papa,  J.A.,  Douglas,  A.F.,  Fortner,  L.D.,  &  Markwardt,  J.A.  A-I0A  prototype  task  II  performance  and  flying 
qualities  evaluation.  AFFTC-TR-73-7.  AD-B023  8SSL.  Edwards  AFB.  CA:  Air  Force  Flight  Test  Center. 
March  1973. 

Pape,  J.K.,  &  Bridges,  R.D.,  Jr.  Preliminary  evaluation  of  the  YA-IOA  flight  control  system  modifications. 
AFFTC-TR-74-I2.  AD-B004  706L.  Edwards  AFB.  CA:  Air  Force  Flight  Test  Center.  April  1974. 

Ryan,  L.E..  Scott,  P.G.,  &  Browning.  R.F.  The  effects  of  simulator  landing  practice  and  the  contribution  of 
motion  simulation  to  P-3  training.  TAEG  Report  No.  63.  Orlando.  FL:  Navy  Training  Analysis  and 
Evaluation  Group.  September  1978. 

Unitt,  P.J.  Preliminary  evaluation  of  A-10A  handling  qualities.  AFFTC-TR-76-1.  AD-B023  992L.  Edwards  AFB. 
CA:  Air  Force  Flight  Test  Center.  January  1976. 

Waag,  W.L.  Training  effectiveness  of  visual  and  motion  simulation.  AFHRL-TR-79-72.  AD-A094  530.  Williams 
AFB.  AZ:  Operations  Training  Division.  Air  Force  Human  Resources  Laboratory.  January  1981. 


APPENDIX  A:  INFLIGHT  MAIN  EFFECT  MEANS 


Table  4-1.  RMS  Means  for  Full  and  Restricted  FOV  (Inflight) 


Variable 

Restricted  FOV 

Full  FOV 

Roll  Rate 

.13695 

.11202 

Pitch 

8.69007 

7.88251 

Pilch  Rate 

.06879 

.05331 

Vertical  Velocity 

8.20441 

7.152(6 

Airspeed 

182.27250 

184.(6107 

Angle  of  Attack 

9.11427 

8.11340 

Altitude 

2941.60779 

2894.5(068 

C-Load 

1.19778 

1.16384 

Hank  Angle 

22.97178 

19.23351 

Table  A -2.  RMS  Means  for  PM  and  No  PM  (Inflight) 

Variable 

Platform  Motion 

No  Motion 

Roll  Rale 

.12218 

.12680 

Pitch 

8.33181 

8.2(077 

Pitch  Rate 

.06444 

.05766 

Vertical  Velocity 

7.57597 

7.780*10 

Airspeed 

183.29812 

183.(35(5 

Angle  of  Attack 

8.6(597 

8.58170 

Altitude 

2956.12384 

2880.02  (66 

C-Load 

1.17131 

1.1*1032 

Rank  Angle 

20.80275 

21.(0251 

Table 

4-3.  RMS  Means  for  Single  Engine  and  MRFCS  Failures  (Inflight) 

Variable 

Single  Ktiffine  Failure 

MRFCS  Failure 

Roll  Rate 

.11792 

.13105 

Pitch 

7.22590 

9.3(668 

Pitch  Rate 

.02117 

.08093 

Vertical  Velocity 

5.36136 

9.9945 1 

Airspeed 

187.69297 

1 79.04 160 

Angie  of  Attack 

7.80535 

9.42232 

Altitude 

2880.16)99 

2955.98657 

C-latad 

1.15292 

1.20870 

Bank  Angle 

19.97979 

22.22550 

Table  4-4.  RMS  Means  for  Failure 

Points  (Inflight) 

Variable 

Qimbififf  Turn 

.1)1  Turn 

Approach 

Roll  Rate 

.09200 

.17885 

.10261 

Pilch 

9.83  (62 

7.56069 

7.(6356 

Pilch  Rate 

.03551 

.09967 

.04794 

Vertical  Velocity 

6.81709 

9.52818 

6.68*173 

Airspeed 

187.(1512 

194.92847 

167.7.5686 

Angie  of  Attack 

6.81(27 

9.3*1695 

9.63029 

Altitude 

2984.14128 

3607.75797 

2162.02460 

C-l,oad 

1.03105 

1.4(681 

1.06457 

Bank  Angle 

18.22932 

30.70109 

14.37754 

23 
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APPENDIX  B-.  LANDING  MAIN  EFFECT  MEANS 


Table  B-l.  RMS  Means  for  Full  and  Restricted  FOV  (Landings) 


Variable 

Full  FOV 

Restricted  FOV 

Roll  Rate 

.04354 

.05904 

Pitch 

5.40833 

5.61618 

Pitch  Rate 

.01885 

.02009 

Vertical  Velocity 

2.53890 

2.82079 

Airspeed 

144.92545 

146.16489 

Normal  Force 

17513.95508 

17281.28979 

Angle  of  Attack 

7.46288 

7.54555 

Centerline  Deviation 

287.73039 

721.18256 

Distance  Threshold 

5122.11676 

5578.89551 

Bank  Angle 

3.45431 

4.60661 

Table  B-2.  RMS  Means  for  PM  and  No  PM  (Landings) 

Variable 

Platform  Motion 

No  Motion 

Roll  Rate 

.05106 

.05152 

Pitch 

5.44809 

5.b6642 

Pitch  Rate 

.01943 

.01950 

Vertical  Velocity 

2.65348 

2.70620 

Airspeed 

145.57050 

145.51904 

Norm  Force 

17365.61304 

17429.63208 

Angle  of  Attack 

7.43701 

7.57142 

Onterline  Deviation 

164.94418 

543.96867 

Distance  Threshold 

5338.82129 

5362.19104 

Bank  Angle 

3.82878 

4.23213 

Table  li-i.  RMS  Means  for  Single  Engine  and  MRFCS  Failures  (Landings) 


Variable 

Single  Kngine  Failure 

MRKdS  Failure 

Roll  Rate 

.05615 

.04643 

I’iteh 

5.58407 

5.53045 

Pitch  Rate 

.01607 

.02287 

Vertical  Velocity 

2.40130 

2.05820 

Airspeed 

145.48868 

1  45.60166 

Norm  Force 

17522.24878 

1 7272.00585 

Angle  of  Attack 

7.53821 

7.47022 

Centerline  Deviation 

368.64005 

640.27181 

Distance  Threshold 

5307.64005 

5303.04044 

Rank  Angle 

3.61328 

1  4  4761 

Table  II- 1.  RMS  Means 

for  Trials  (Landings) 

Variable 

Trial  1 

Trial  2 

Trial  3 

Roll  Rate 

.05020 

.0501  4 

.04444 

Pitch 

5.651 10 

5.51100 

5.50040 

Pitch  Rate 

.021  40 

.01020 

.01780 

Vertical  Velocity 

2.07  416 

2.73151 

2.33385 

Airspeed 

148.40305 

1  45.30156 

1  42.0.3008 

Norm  Force 

16312.01028 

17673.36523 

1 8206.50085 

Angle  of  Attack 

7.44810 

7.54457 

7.51080 

Centerline  Deviation 

776.0.350) 

.384.87100 

351.5616 

Distance  Threshold 

5745.01078 

5180.04061 

5125.56042 

Bank  Angle 

4.6835 

4.0.3257 

3.375.3 

25 
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a m:\mx  C:  mr res  scknario 


THE  SCENARIO  IS  AS  FOLLOWS: 

1.  TAKEOFF. 

2.  CLIMBING  LEFT  TURN  TO  HEADING  OF  300° 

A.  MAINTAIN  200  KNOTS  AIRSPEED  IN  CLIMB. 

B.  LEVEL-OFF  AT  6000  MSL. 

3.  PERFORM  3-G,  90°RIGHT  TURN:  GREATER  THAN  60  BANK. 

4.  LEFT  TURN  TO  HEADING  OF  300° 

5.  LEFT  TURN  TO  FINAL  AT  7  DME. 

6.  MAKE  LANDING  APPROACH  AT  MINIMUM  OF  150  KNOTS  AIRSPEED. 

7.  LAND. 


SCHEMATIC 


PRIOR  TC  EACH  TRIAL: 

1  SPEED  BRAKE  CLOSED. 

2  FLAPS  SET  AT  7° 

3.  GEAR  HANDLE  DOWN. 

4.  AUX  GEAR  EXTENSION  HANDLE  FULL  IN. 

5.  EMERGENCY  BRAKE  HANDLE  IN. 

6  MRFCS  SWITCH  NORMAL 

7.  SET  HSI  COURSE  SELECTOR  TO  125. 

8.  SPEED  BRAKE  EMERGENCY  RETRACT  SWITCH  IN  AFT  POSITION. 

9.  FLAP  EMERGENCY  RETRACT  SWITCH  IN  AFT  POSITION. 

10.  ALL  SAS  SWITCHES  ON. 
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2.  A- 10  ASPT  simulation  is  \IRF(S  flight  conditions. 
Kale  simulator  control  feci  for: 


Too 

Like 

Too 

Sensitive 

Aircraft 

Heavy 

a.  Takeoff  -  Turning  ('.limb 

Pitch 

1 

2 

a 

1 

.1 

Roll 

1 

2 

A 

1 

.J 

Yaw 

1 

2 

A 

1 

3 

b.  Ag  Turn 

Pitch 

1 

y 

A 

l 

3 

Roll 

1 

2 

A 

l 

3 

Y  aw 

1 

2 

A 

1 

3 

c.  Landing 

Pitch 

1 

•> 

A 

f 

3 

Roll 

1 

2 

A 

1 

3 

Yaw 

1 

2 

A 

t 

3 

A.  In  manual  reversion,  how  we 

II  were  you  able  to  maintain  your 

<it*sirrd 

pitch  angle 

during  each 

of  1  lit- 

following: 

Climbing  Turn 

V  er\ 
Well 

1 

2 

Ycceptabh 

A 

1 

Very 

Poorly 

3 

Ag  Turn 

1 

•> 

A 

1 

5 

Landing 

1 

2 

A 

1 

5 

L  In  manual  reversion,  how  well 

were  you  able  to  maintain  your  desired  roll  rate  during  each  of  the  following 

tasks'.'1 

Climhing  Turn 

Ycrv 

Well 

1 

•y 

Ycceptabh 

A 

t 

Very 

Poorly 

3 

Ag  Turn 

1 

•) 

A 

t 

3 

Landing 

1 

•> 

A 

t 

3 

.’).  In  manual  reversion,  how  well 

you  were  able  to  maintain  your  stability  in 

yaw  during  each  of  the  following 

tasks: 


V  ery 

Well  Vcejtlahle 

2  A 


\  ery 
Poorlv 


Climbing  Turn 


I 
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MRIV.S  Study  (Questionnaire  II 


^aiue  _ _ _________ _ _  Organization 

I.  How  realist! e  do  you  feel  tile  siinulalion  of  manual  reversion  was  in  this  study? 


2.  I  sing  the  altaehed  sheet,  circle  the  number  that  best  rates  the  training  value  for  each  of  the  inodes  of 
simulation  flown. 


.1.  I.isl  any  difficulty  you  encountered  in  fly  ing  under  l lie  various  simulation  modes.  Be  as  specific  as  possible. 


I.  General  comments. 


’>.  Have  you  experienced  manual  reversion  in  an  aircraft? 


( 'limbing  Turn 

.lg  Turn 

Approach 

r  a, 

il  A  JL 

J1  A  JL 

Full  FO\  Motion 

1  2  .1 

t  :> 

1  2 

1  l 

1  2 

■!  f  5 

full  FOX  No  Motion 

I  2  :» 

f  :» 

1  2 

i  f  :> 

1  2 

II  f  5 

l.imiled  ION  Motion 

i  2  :i 

t  :» 

1  2 

:i  f 

1  2 

:i  t  .i 

l.imited  F(  IN  No  Motion 

i  2  :i 

t  :> 

1  2 

i  f  :> 

1  2 

1  t  s 

Mote 

I*  -  I ’nor 
\  -  \eecplablc 
F  -  Excellent 
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